» 



(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 

International Bureau 

(43) International Publication Date 
25 September 2003 (25.09.2003) 




PCT 



t mil imini ii iiiiii 11111 mi 1 11 he iieii iiiei iiui iiiii iim mi iimn mi mi mi 

(10) International Publication Number 

WO 03/079637 Al 



(51) International Patent Classification 7 : H04L 29/06, 

29/08, H04Q 7/32 

(21) International Application Number: PCT/US03/07056 

(22) International Filing Date: 10 March 2003 (10.03.2003) 

(25) Filing Language: English 

(26) Publication Language: English 



(30) Priority Data: 

10/095,751 



1 1 March 2002 (1 1.03.2002) US 



(71) Applicant: ERICSSON INC. [US/US]; 6300 Legacy, 
Piano, TX 75024 (US). 

(72) Inventor: FENTON, Gregg, A.; 3 Ambrose Lane, North- 
port, NY 11768 (US). 

(74) Agents: HAN, John, C. et al.; Ericsson Inc., 6300 Legacy, 
MS EVW 2-C-2, Piano, TX 75024 (US). 

(81) Designated States (national): AE, AG, AL, AM, AT, AU, 
AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CO, CR, CU, 
CZ, DE, DK, DM, DZ, EC, EE, ES, FI, GB, GD, GE, GH, 



GM, HR, HU, ID, IL, IN, IS, JP, KB, KG, KP, KR, KZ, LC, 
LK, LR, LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, 
MX, MZ, NO, NZ, OM, PH, PL, PT, RO, RU, SC, SD, SE, 
SG, SK, SL, TJ, TM, TN, TR, TT, TZ, UA, UG, UZ, VC, 
VN, YU, ZA, ZM, ZW. 

(84) Designated States (regional)*. ARIPO patent (GH, GM, 
KB, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZM, ZW), 
Eurasian patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), 
European patent (AT, BE, BG, CH, CY, CZ, DE, DK, EE, 
ES, FI, FR, GB, GR, HU, IE, IT, LU, MC, NL, PT, RO, 
SE, SI, SK, TR), OAPI patent (BF, BJ, CF, CG, CI, CM, 
GA, GN, GQ, GW, ML, MR, NE, SN, TD, TG). 

Declarations under Rule 4.17: 

— as to applicant 's entitlement to apply for and be granted a 
patent (Rule 4.17(H)) for all designations 

— as to the applicant 's entitlement to claim the priority of the 
earlier application (Rule 4. 1 7 (Hi)) for all designations 

Published: 

— with international search report 

— before the expiration of the time limit for amending the 
claims and to be republished in the event of receipt of 
amendments 

[Continued on next page] 



(54) Title: METHOD, APPARATUS AND SYSTEM FOR REFORMATTING A MULTIMEDIA MESSAGE FOR DELIVERY TO 
A TERMINAL DURING CONNECTIONLESS COMMUNICATIONS 



-302 



Saver 



-316 



Retire 
Content 
CoTMsrsion 



o 



-306 



-310 



Reject Message 



,--312 
• Termhal Capably Request 

^314 
TemTBl Capabftes — 

z-318 



' Message Notification 



-322 



- Accept Message 



^324 

— Reqjest Message Conterts 

^326 

- RefcnraDEd Message Corterfs 



304-^ 



Mobfe 
Terminal 



-308 



Automatic 



Check 



-320 



Automatic 



Check 



-328 



Render and 
Display Message 



(57) Abstract: The present invention provides a method, apparatus and system for delivery to a terminal during connectionless 
communications. The present invention sends a first multimedia message notification (306) to the terminal (302). Whenever the 
terminal (302) rejects delivery (310) of the multimedia message, the present invention requests (312) one or more capabilities of the 
terminal (302), reformats (316) the multimedia message based on the requested capabilities and sends a second multimedia message 
notification (318) to the terminal (302). Whenever the terminal (302) accepts delivery (322) of the multimedia message, the present 
invention sends the reformatted multimedia message (326) to the terminal (302). This method can be implemented using a computer 



WO 03/079637 Al illlil IHHlll 11 lilllHli 1 1 UN M! UlillH I II 111 I mill liimilHiMlllililUll 



For two-letter codes and other abbreviations, refer to the "Guid- 
anceNotes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



WO 03/079637 



PCT/US03/07056 



METHOD, APPARATUS AND SYSTEM FOR 
REFORMATTING A MULTIMEDIA MESSAGE FOR DELIVERY TO A 
TERMINAL DURING CONNECTIONLESS COMMUNICATIONS 

5 TECHNICAL FIELD OF THE INVENTION 

The present invention relates generally to the field of communications and, more 
particularly, to a method, apparatus and system for reformatting a multimedia message for 
delivery to a terminal during connectionless communications. 

10 BACKGROUND OF THE INVENTION 

Multimedia consists of one or more media elements, such as text, voice, image and 
video, and it is the combination of these media elements in an ordered synchronized manner 
that creates a multimedia presentation, which is also referred to as multimedia content. A 
non-real time multimedia message as observed by the user is a combination of one or more 

15 different media elements in a multimedia presentation that can be transferred between users 
without having to be transferred in real time. 

With the popularity of the Internet and increased capability of personal computers, 
multimedia technology has and continues to rapidly develop to allow new capabilities, such as 
multimedia messages, games, presentations and services that are now considered to be a part 

20 of every day life. Moreover, the reduced size and increased capabilities of handheld devices, 
such as personal data assistants ("PDAs"), mobile phones and combinations thereof, have 
made the delivery of multimedia content to such devices more of a possibility. Most of these 
user terminals have different capabilities with respect to available memory, display size and 
display type. As a result a terminal may reject delivery of a particular multimedia message if 

25 the multimedia message exceeds the capabilities of the terminal. 

There is, therefore, a need for a method, apparatus and system for reformatting a 
multimedia message for delivery to a terminal during connectionless communications. 
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SUMMARY OF THE INVENTION 

The present invention provides a flexible architecture that supports present and future 
multimedia messaging technologies and reformats multimedia messages for delivery to 
terminals during connectionless communications. As a result, any given terminal will reject 

5 fewer multimedia messages due to situations where the multimedia message exceeds the 
capabilities of the terminal. Moreover, the present invention can optimize the reformatting of 
the multimedia message based on one or more terminal or operating criteria. 

The present invention provides a method of reformatting a multimedia message for 
delivery to a terminal during connectionless communications. The present invention sends a 

10 first multimedia message notification to the terminal. Whenever the terminal rejects delivery 
of the multimedia message, the present invention requests one or more capabilities of the 
terminal, reformats the multimedia message based on the requested capabilities and sends a 
second multimedia message notification to the terminal. Whenever the terminal accepts 
delivery of the multimedia message, the present invention sends the reformatted multimedia 

15 message to the terminal. This method can be implemented using a computer program 
embodied on a computer readable medium wherein each function is executed using a code 
segment. 

In addition, the present invention provides a system for reformatting a multimedia 
message during connectionless communications that includes a terminal and a server. The 

20 server sends a first multimedia message notification to the terminal. Whenever the terminal 
rejects delivery of the multimedia message, the server requests one or more capabilities of the 
terminal, reformats the multimedia message based on the requested capabilities and sends a 
second multimedia message notification to the terminal. Whenever the terminal accepts 
delivery of the multimedia message, the server sends the reformatted multimedia message to 

25 the terminal. 

Other features and advantages of the present invention will be apparent to those of 
ordinary skill in the art upon reference to the following detailed description taken in 
conjunction with the accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

For a better understanding of the invention, and to show by way of example how the 
same may be carried into effect, reference is now made to the detailed description of the 
invention along with the accompanying figures in which corresponding numerals in the 
5 different figures refer to corresponding parts and in which: 

FIGURE 1 is a block diagram illustrating a multimedia messaging system in 
accordance with an embodiment of the present invention; 

FIGURES 2A and 2B are sequence diagrams illustrating the acceptance and rejection 
of a multimedia message by a terminal in accordance with the prior art; and 
10 FIGURE 3 is a sequence diagram illustrating the acceptance of a multimedia message 

by a terminal in accordance with one embodiment of the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

While the making and using of various embodiments of the present invention are 

15 discussed in detail below, it should be appreciated that the present invention provides many 
applicable inventive concepts, which can be embodied in a wide variety of specific contexts. 
For example, in addition to telecommunications systems, the present invention may be 
applicable to other forms of communications or general data processing. Other forms of 
communications may include communications between networks, communications via 

20 satellite, or any form of communications not yet known to man as of the date of the present 
invention. The specific embodiments discussed herein are merely illustrative of specific ways 
to make and use the invention and do not limit the scope of the invention. 

The present invention provides a flexible architecture that supports present and future 
multimedia messaging technologies and reformats multimedia messages for delivery to 

25 terminals during connectionless communications. As a result, any given terminal will reject 
fewer multimedia messages due to situations where the multimedia message exceeds the 
capabilities of the terminal. Moreover, the present invention can optimize the reformatting of 
the multimedia message based on one or more terminal or operating criteria. 

Referring to FIGURE 1, a block diagram illustrating a multimedia messaging system 

30 100 in accordance with an embodiment of the present invention. The system 100 includes a 
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sending user's terminal 102, a multimedia service center ("MMS-C") 104, a message gateway 
106 and a receiving user's terminal 108. The sending and receiving user's terminals 102 and 
108 are both multimedia compatible. In addition, the sending and receiving user's terminals 
102 and 108 are communicably connected to the multimedia service center 104 and message 

5 gateway 106, respectively, via one or more communication networks, such as fixed networks, 
mobile networks, Global System for Mobile Communications ("GSM") second generation 
("2G") mobile networks, third generation ("3G") mobile networks and Internet/IP networks. 
The MMS-C 104 is responsible for storage and handling of incoming and outgoing 
multimedia messages and for the transfer of multimedia messages between different 

10 messaging systems. The message gateway 106 is responsible for notifying the receiving 
user's terminal 108 that a multimedia message is ready for delivery and subsequently handles 
the delivery of the multimedia message to the receiving user's terminal 108. The message 
gateway 106 may include a WAP/Push Proxy Gateway ("WAP PPG") 110 and a WAP 
gateway 112. Alternatively, the message gateway 106 may include a SMSC in place of the 

15 WAP PPG 110 and a web browser in place of the WAP gateway 112. The MMS-C 104 is 
communicably connected to the message gateway 106 via a network that uses standard 
Internet-type protocols 1 14, such as Hypertext Transfer Protocol ("HTTP"). 

In operation, the sending user's terminal 102 sends the multimedia message 1 16 to the 
MMS-C 104 where it is stored pending delivery to the receiving user's terminal 108. The 

20 MMS-C 104 sends a notification 118 (Notify. Ind) to the WAP PPG 1 10, which in turn sends a 
multimedia message notification 120 to the receiving user's terminal 108 indicating that the 
multimedia message 1 16 has been received and is ready for delivery. When the user wants to 
receive the multimedia message 116, he or she sends a retrieve message 122 from the 
receiving user's terminal 108 to the WAP gateway 112, which sends a retrieval request 124 

25 (Retrieve.Ind) to the MMS-C 104. Alternatively, the user terminal 108 may automatically 
send the retrieve message 122 after checking the capability of the terminal 108 to receive the 
multimedia message 116. The MMS-C 104 sends the multimedia message 1 16 to the WAP 
gateway 112, which forwards the multimedia message 116 to the receiving user's terminal 
108 and sends an acknowledgment 126 (Ack.Ind) back to the MMS-C 104 indicating that the 

30 multimedia message 116 has been received. As previously mentioned, the multimedia 
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message 1 16 may include text, pictures and audio files. The picture may be encoded in JPEG, 
GIF 89a, GIF 89b, PNG, MNG or WBMP formats. 

Now referring briefly to and discussing the prior art in reference to FIGURES 2A and 
2B, sequence diagrams illustrating the acceptance and rejection of a multimedia message by a 
5 terminal in accordance with the prior art are shown. A two stage delivery mechanism is 
employed to deliver multimedia content to a mobile terminal. This two stage process is used 
because the data connection is initiated by the terminal 204 instead of by the server 202 or 
network. A separate notification to the terminal 204 is required for the terminal 204 to 
establish the session. 

10 With respect to the acceptance sequence shown in FIGURE 2A, the server or MMS-C 

202 sends a multimedia message notification 206 to the mobile terminal 204. The multimedia 
message notification 206 contains the originator of the multimedia message, the expiration of 
the multimedia message and the size of the multimedia message. The content of the 
multimedia message is not stated at this time. This notification process is performed in a 

15 connectionless environment, such that the server 202 is not in direct communication with the 
terminal 204. The terminal 204 then performs an automatic memory availability check 208 to 
determine whether the multimedia message can be stored within the terminal 204 on a 
subsequent message download. Note that other capabilities of the terminal 204 may also be 
checked. Upon a successful automatic memory availability check 208, the terminal 204 may 

20 optionally send an accept 210 the multimedia message. Thereafter, the terminal 208 requests 
the multimedia message contents 212 from the server 202, which then sends the multimedia 
message contents 214 to the terminal 204. The terminal 204 then renders and displays the 
multimedia message 216. 

With respect to the rejection sequence shown in FIGURE 2B, the server or MMS-C 

25 202 sends a multimedia message notification 206 to the mobile terminal 204, which then 
performs an automatic memory availability check 208. Note that other capabilities of the 
terminal 204 may also be checked. If the automatic memory availability check 208 fails, the 
terminal 204 rejects the multimedia message 218 and the multimedia message is not 
delivered. Note that the rejection message 218 does not necessarily indicate the exact cause 
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of the rejection. Upon receipt of the rejection message 218, the server 204 may terminate any 
further attempts to deliver the content. 

Now turning back to the discussion of the present invention in reference to FIGURE 3, 
a sequence diagram illustrating the acceptance of a multimedia message by a mobile terminal 

5 304 in accordance with one embodiment of the present invention is shown. The server or 
MMS-C 302 sends a first multimedia message notification 306 to the terminal 304. The 
terminal 304 then performs an automatic memory availability check 308 to determine whether 
the multimedia message can be stored within the terminal 304 on a subsequent message 
download. Note that other capabilities of the terminal 304 may also be checked at this time. 

10 Whenever the terminal 304 rejects delivery 310 of the multimedia message, the present 
invention requests one or more capabilities 312 of the terminal 304 or other system cognizant 
of the one or more capabilities 312 of the terminal 304, and subsequently receives the 
requested capabilities 3 14 of the terminal 304. For example, the one or more capabilities 312 
can be derived by examining the equipment identifier ("IMEI") that is unique to each terminal 

15 304 and terminal manufacturer. The one or more capabilities 312 typically involve the picture 
rendering capabilities, the amount of memory available for multimedia content, the size of the 
display and the type of the display (e.g., 256 color, black and white, etc.), and the audio 
playback capability. This information may be derived from basic information available from 
the terminal 304 or other system cognizant of the one or more capabilities 312 of the terminal 

20 304 or commonly available known capabilities 312 of the terminal 304. With this 
information, the server 302 can determine whether the multimedia message was rejected due 
to not enough memory within the terminal 304 or some other reason. The server 302 then 
reformats 316 the multimedia message based on the requested capabilities, which will 
typically involve a picture content conversion. 

25 For example, reformatting 316 may include conversion of the picture to a size 

compatible with the terminal 304, or conversion of the picture to a method compatible with 
the display format (i.e. reduction of the picture resolution to 256 colors, elimination of color 
aspects, etc.), or conversion of the picture compression to reduce the size of the file but 
maintain the rendering capabilities within the terminal 304 (i.e. convert from JPEG to 

30 GIF89a, reduce size of the image, etc.). Conversion may also include audio format re- 
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encoding to reduce the overall size of the multimedia message (e.g. WAV to AMR, etc.), 
make the audio format compatible with the playback format of the terminal 304 or optimize it 
for playback on the terminal 304. The server 302 then sends a second multimedia message 
notification 318 containing updated information about the reformatted multimedia message to 

5 the terminal 304. The terminal 304 repeats its automatic memory availability check 320 as 
previously described. Whenever the terminal 304 accepts delivery 322 of the multimedia 
message, the terminal 304 later requests the multimedia message contents 324. The server 
302 sends the reformatted multimedia message 326 to the terminal 304. The terminal 304 
then renders and displays the multimedia message 328. 

10 The order and performance of the steps described above is dependant upon the 

capability of the terminal 304 and the effectiveness of reduction in size of the multimedia 
message to comply with the one or more capabilities of the terminal 304. Preferably, the 
reformatting 316 should be optimized such that the resolution of the content is maximized to 
the highest extent to allow the original multimedia message presentation to be maintained at 

15 the highest degree of quality. These method can be implemented using a computer program 
embodied on a computer readable medium wherein each function is executed using a code 
segment. 

The embodiments and examples set forth herein are presented to best explain the 
present invention and its practical application and to thereby enable those skilled in the art to 

20 make and utilize the invention. However, those skilled in the art will recognize that the 
foregoing description and examples have been presented for the purpose of illustration and 
example only. The description as set forth is not intended to be exhaustive or to limit the 
invention to the precise form disclosed. Many modifications and variations are possible in 
light of the above teaching without departing from the spirit and scope of the following 

25 claims. 
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WHAT IS CLAIMED IS: 

1. A method of reformatting a multimedia message for delivery to a terminal during 
connectionless communications comprising the steps of: 

sending a first multimedia message notification to the terminal; 
5 whenever the terminal rejects delivery of the multimedia message: 

requesting one or more capabilities of the terminal, 

reformatting the multimedia message based on the requested capabilities, and 
sending a second multimedia message notification to the terminal; and 
sending the reformatted multimedia message to the terminal whenever the terminal 
10 accepts delivery of the multimedia message. 

2. The method as recited in claim 1 , further comprising the steps of: 

determining which of the requested capabilities caused the terminal to reject delivery 
of the multimedia message; and 
15 wherein the reformatting of the multimedia message is based on the requested 

capabilities that were determined to cause the terminal to reject delivery of the multimedia 
message. 

3. The method as recited in claim 1, wherein the reformatting is optimized to maximize 
20 resolution of the content of the multimedia message. 

4. The method as recited in claim 1, wherein the step of reformatting the multimedia 
message comprises the step of converting the multimedia content within the multimedia 
message to a type compatible with the terminal. 

25 

5. The method as recited in claim 1, wherein the step of reformatting the multimedia 
message comprises the step of converting the multimedia content within the multimedia 
message to a format compatible with the terminal. 
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6. The method as recited in claim 1, wherein the step of reformatting the multimedia 
message comprises the step of converting the multimedia content within the multimedia 
message to a resolution compatible with the terminal. 

5 7. The method as recited in claim 1, wherein the step of reformatting the multimedia 
message comprises the step of reducing the size of the multimedia message to a size 
compatible with the terminal. 

8. The method as recited in claim 1, wherein the step of reformatting the multimedia 
10 message comprises the step of re-encoding the audio format of the multimedia message to be 

compatible with the playback format of the terminal. 

9. The method as recited in claim 1, wherein the one or more capabilities of the terminal 
are obtained from the terminal. 

15 

10. The method as recited in claim 1, wherein the one or more capabilities of the terminal 
are obtained from a system cognizant of the one or more capabilities of the terminal. 

1 1 . The method as recited in claim 1, wherein the one or more capabilities of the terminal 
20 are obtained from commonly available known capabilities of the terminal. 

12. A computer program embodied on a computer-readable medium for reformatting a 
multimedia message for delivery to a terminal during connectionless communications 
comprising: 

25 a code segment adapted to sending a first multimedia message notification to the 

terminal; 

whenever the terminal rejects delivery of the multimedia message: 

a code segment adapted to request one or more capabilities of the terminal, 
a code segment adapted to reformat the multimedia message based on the 
30 requested capabilities, and 
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a code segment adapted to send a second multimedia message notification to 
the terminal; and 

a code segment adapted to sending the reformatted multimedia message to the 
terminal whenever the terminal accepts delivery of the multimedia message. 

5 

13. The computer program as recited in claim 12, further comprising: 

a code segment adapted to determining which of the requested capabilities caused the 
terminal to reject delivery of the multimedia message; and 

wherein the reformatting of the multimedia message is based on the requested 
10 capabilities that were determined to cause the terminal to reject delivery of the multimedia 
message. 

14. The computer program as recited in claim 12, wherein the reformatting is optimized to 
maximize resolution of the content of the multimedia message. 

15 

15. The computer program as recited in claim 12, wherein the code segment is adapted to 
reformat the multimedia message comprises a code segment adapted to converting the 
multimedia content within the multimedia message to a type compatible with the terminal. 

20 16. The computer program as recited in claim 12, wherein the code segment adapted to 
reformat the multimedia message comprises a code segment adapted to converting the 
multimedia content within the multimedia message to a format compatible with the terminal. 

17. The computer program as recited in claim 12, wherein the code segment adapted to 
25 reformat the multimedia message comprises a code segment adapted to converting the 
multimedia content within the multimedia message to a resolution compatible with the 
terminal. 
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ls. The method as recited in claim 12, wherein the step of reformatting the multimedia 
message comprises the step of re-encoding the audio format of the multimedia message to be 
compatible with the playback format of the terminal. 

5 19. The computer program as recited in claim 12, wherein the code segment adapted to 
reformat the multimedia message comprises a code segment adapted to reducing the size of 
the multimedia message to a size compatible with the terminal. 

20. The computer program as recited in claim 12, wherein the one or more capabilities of 
10 the terminal are obtained from the terminal. 

21. The computer program as recited in claim 12, wherein the one or more capabilities of 
the terminal are obtained from a system cognizant of the one or more capabilities of the 
terminal. 

15 

22. The computer program as recited in claim 12, wherein the one or more capabilities of 
the terminal are obtained from commonly available known capabilities of the terminal. 

23. A system for reformatting a multimedia message during connectionless 
20 communications, the system comprising: 

a terminal; 

a server that sends a first multimedia message notification to the terminal; 
the server, whenever the terminal rejects delivery of the multimedia message, 
requests one or more capabilities of the terminal, 
25 reformats the multimedia message based on the requested capabilities, and 

sends a second multimedia message notification to the terminal; and 
the server sends the reformatted multimedia message to the terminal whenever the 
terminal accepts delivery of the multimedia message. 
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24. The system as recited in claim 23, wherein the server determines which of the 
requested capabilities caused the terminal to reject delivery of the multimedia message, and 
wherein the reformatting of the multimedia message is based on the requested capabilities that 
were determined to cause the terminal to reject delivery of the multimedia message. 

5 

25. The system as recited in claim 23, wherein the reformatting is optimized to maximize 
resolution of the content of the multimedia message. 

26. The system as recited in claim 23, wherein reformatting of the multimedia message 
10 comprises converting the multimedia content within the multimedia message to a type 

compatible with the terminal. 

27. The system as recited in claim 23, wherein reformatting of the multimedia message 
comprises converting the multimedia content within the multimedia message to a format 

15 compatible with the terminal. 

28. The system as recited in claim 23, wherein reformatting of the multimedia message 
comprises converting the multimedia content within the multimedia message to a resolution 
compatible with the terminal. 

20 

29. The system as recited in claim 23, wherein reformatting of the multimedia message 
comprises reducing the size of the multimedia message to a size compatible with the terminal. 

30. The method as recited in claim 23, wherein the step of reformatting the multimedia 
25 message comprises the step of re-encoding the audio format of the multimedia message to be 

compatible with the playback format of the terminal. 
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31. The system as recited in claim 23, wherein the one or more capabilities of the terminal 
are obtained from the terminal. 

32. The system as recited in claim 23, wherein the one or more capabilities of the terminal 
5 are obtained from a system cognizant of the one or more capabilities of the terminal. 

33. The system as recited in claim 23, wherein the one or more capabilities of the terminal 
are obtained from commonly available known capabilities of the terminal. 
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